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Abstract 

A sensitive search for the lepton-number-violating decay H~ — > pu~u~ has been performed 
using a sample of ~ 10 9 E~ hyperons produced in 800 GeV/c p-Cu collisions. We obtain £>(H~ — > 
pfi~u~) < 4.0 x 10~ 8 at 90% confidence, improving on the best previous limit by four orders of 
magnitude. 

PACS numbers: 13.30. Ce, 11.30.Hv, 14.20.Jn, 14.60. St 



9 University of South Alabama, Mobile, Alabama 36688, USA 

10 University of Virginia, Charlottesville, Virginia 22904, USA 



1 



The conservation of lepton and lepton-fami.y numbers (the latter notably v.olated by 
neutrino mixing) is one of the fundamental puzzles in physics [1]. These conservation laws, 
while satisfied in the standard model, are based on no known deeper principle. For exam- 
ple, lepton-number conservation, unlike such global conservation laws as that for electric 
charge, is not associated with any local gauge invariance. With neutrino oscillation now es- 



tablished experimentally |2j|, models incorporating neutrino mass and lepton-family-number 
nonconservation must be considered. These typically feature Q Majorana neutrinos, whose 
exchange changes the total lepton number L by two units. Conversely, the observation of 
AL = 2 processes could imply the existence of massive Majorana neutrinos 4]. Experimental 
searches for lepton-number nonconservation are thus of fundamental importance. 

The most stringent limits on lepton-number nonconservation come from searches for 
neutrinoless double-beta (OvflP) decay, the best being £i/ 2 > 1.9 x 10 25 y (C.L.=90%) for 
-Ge Q. However, searches for H, - H 2m where H lf are hadrons, can provide comple- 
mentary information. Figure Q shows a possible mechanism. Predicting rates for such decays 
is challenging, since they depend sensitively on details of the underlying dynamics of neutrino 
mixing and of the hadronic matrix element 0, Q . These rates are unconstrained by limits 
on 0h>/3(3 decays and by conversion rates of muons to electrons in nuclear interactions 0. 
Limits have been set on such processes in D, B, and K decays at branching-ratio sensitivi- 
ties ranging from 10~ 4 to 10 -9 [9]. However, in the baryon sector, experimental knowledge 
on such decays is meager. The only available hunts are S(A+ Trf?) < 7.0 X 10- fl 
and B(e — ■» pfi // ) < 3.7 x 10 |8j; the latter, based on 8150 c events observed with 
the Brookhaven National Laboratory 31 in bubble chamber [ijj], remains until now the best 
limit on AL = 2 processes in the hyperon sector. 

We report a search for S~ — ► pfi~fi~ in the HyperCP experiment (Fermilab E871) based 
on ~ 10 9 S~ decays — a vastly larger sample than previously available. The experimental 
arrangement (Fig. EJ) and muon selection criteria are described in [ijj. In brief, a negatively 
charged secondary beam was formed by the interaction of 800GeV/c primary protons from 
the Tevatron in a 0.2 x 0.2 x 6 cm 3 copper target, with the sign and momenta of secondaries 
selected by a 6.096-m-long curved collimator within a 1.667 T dipole magnetic field. The 
mean momentum of the secondaries was about 160 GeV/c, with w 25% FWHM momentum 
spread. The typical secondary-beam rate was 13 MHz at the exit of the collimator. Hy- 
peron decays occurring within a 13-m-long evacuated pipe (the "vacuum decay region" of 
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FIG. 1: A possible diagram for the decay S — > pfi fj, ; f m represents a Majorana neutrino. 




FIG. 2: Plan view of the HyperCP spectrometer. C1-C8 are multiwire proportional chambers. 
Note that the z scale is compressed by a factor of 10 compared to the x scale. 

Fig. EJ) were reconstructed in three dimensions in a series of high-rate multiwire proportional 
chambers (C1-C8), with wire spacings increasing from 1 to 2 mm. A pair of dipole magnets 
( "analyzing magnets" ) deflected charged particles horizontally with a transverse- momentum 
kick of 1.43 GeV/c. A pair of muon detector stations consisted of planes of vertical and hori- 
zontal proportional tubes with 2.54 cm pitch, interspersed with three layers of f«0.75-m-thick 
iron absorber, followed by vertical and horizontal scintillation hodoscopes. 

The trigger for online data acquisition used two scintillation-counter hodoscopes ( "same- 
sign" and "opposite-sign hodoscopes" in Fig. EJ), located sufficiently far downstream of the 
analyzing magnets that the hyperon decay products were well separated from the secondary 
beam. At least one hodoscope hit from a negative (same-sign) track in coincidence with 
one from a positive (opposite-sign) track was required for a trigger. To suppress muon and 
low-energy backgrounds, the trigger also required a minimum energy deposit in the hadronic 
calorimeter. The calorimeter energy threshold was set sufficiently low that the calorimeter 
trigger was more than 99% efficient for protons from H~ decays within the secondary-beam 
momentum range. 
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The — > decay gives two like-sign muon tracks and a proton track originating 

from a common vertex. The first stage of data reduction selected events with three tracks, at 
least one being a muon track. A muon track was one with hits in at least two of three muon 
proportional-tube planes in both the x and y views. Figure El shows the pn~fi~ invariant- 
mass distribution, which is entirely dominated by background due to misidentified pions. In 
the next analysis stage, the muon requirement was tightened by requiring in-time hits in the 
muon hodoscopes corresponding to hits in the proportional tubes, and two negative muon 
tracks were required as well as a third track of opposite sign (assumed to be the proton). 
The total momentum of the three tracks was required to be between 120 and 250GeV/c, 
consistent with the momentum spectrum of the secondary beam. 

Next, requirements were imposed on the decay vertex, which was reconstructed by fitting 
the three tracks to a common vertex using only the hits in C1-C4. To reduce backgrounds 
from interactions near z = in the collimator material and windows, and in windows 
near z = 1330 cm, the reconstructed vertex was required to lie well within the vacuum 
decay region (i.e., between 65 and 1285 cm downstream of the end of the collimator). To 
suppress the copious backgrounds due to two- vertex hyperon decay (such as the H~ — > Att~ , 
A — ► pn~ decay chain with both pions misidentified as muons due to in-flight decay or 
punch-through in the muon detectors), requirements were imposed on the x 2 of the single- 
vertex fit, as well as on the average distance in the x-y plane between pairs of tracks at 
the z position of the fitted vertex. (This average separation was calculated from the wire 
hits in C1-C4 without imposing the single-vertex constraint.) Based on the vertex-^ 2 and 
average-separation distributions of clean K~ — > 7t~7t~tt + decays, candidates were accepted if 
the % 2 /dof was less than 2.5 and the average separation was less than 0.2 cm. To ensure that 
the parent hyperon was produced in the target, the parent-particle trajectory was traced 
back to the target and required to originate within ±0.5 cm of the target center in both x 
and y (corresponding to ±7 (5.6) standard deviations (a) of the x ta r g et (^/target) resolution). 

For further background rejection, events passing the above requirements were subjected 
to three invariant-mass requirements (K, A, and S vetoes, respectively): (1) events with 
invariant mass between 473 and 513MeV/c 2 (corresponding to ±10 a of the K~ mass reso- 
lution) under the 7r _ 7r~7r + hypothesis were rejected as being K~ — > 7r~7r~7r + decays; (2) if 
the p7r~ invariant mass for either pair of oppositely charged tracks was between 1100 and 
1125MeV/c 2 (±7cr of the resolution), the event was rejected as having a A; (3) if the in- 
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FIG. 3: pfi~ /i~ invariant-mass distribution before full application of selection requirements; note 
broadened and shifted peaks due to ir-fj, misidentification. 

variant mass under the pn^ir^ hypothesis was between 1315 and 1330MeV/c 2 (±4<r of the 
resolution) the event was rejected as being a 2~ — > An~ , A — > pir^ decay. These require- 
ments were based on the observed H~ — ► Att~ sample and Monte Carlo (MC) simulations 
of the signal decay that indicated, for example, that 2~ — > ppTyT decays interpreted as 
2~ — > p-K^-K^ would yield a parent S~ mass exceeding 1330 MeV/c 2 . In addition, since 
K~ — > 7r _ 7r _ 7r + decays on average give a lower value of positive-track momentum than do 
2~ — > pyTjjr decays, the positive-track momentum was required to exceed 56% of the total 
three-track momentum. This requirement was estimated to be 91% efficient for S~ — > ppT pT 
decays while rejecting over 90% of K~ — > 7t~7t~tt + decays. 

Events that passed all of the above requirements were reconstructed under the pyTpT hy- 
pothesis. Figure 0] shows the resulting invariant- mass distribution. There is one event within 
the ll-MeV/c 2 -wide search region corresponding to ±3 a about the 1321.31 MeV/c 2 |9j S~ 
mass. We treat this event as background in determining an upper limit on £>(2~ —* ppT pr\ 
Since there is one event in the ll-MeV/c 2 -wide sideband below the search region and zero 
in that above the search region, the background is estimated as 0.5 ± 0.5 events. 

The normalizing mode for this search was S~ — ► — > p-n^-n^ , recorded using the same 
trigger as the signal mode. It was studied in a "prescaled" sample: only every 100th event 
passing the first stage of data reduction was fully analyzed. The selection requirements were 
the same as for the signal mode, except that the 5- and A-veto, single-vertex, and muon 
requirements were not made and the A-decay vertex was allowed to lie beyond the vacuum 
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FIG. 4: pfj, fj, invariant-mass distribution after application of all selection requirements; inset: 
pir~ir~ invariant-mass distribution from the normalization sample. 




FIG. 5: Comparison of normalization-mode Monte Carlo (dashed histogram) and data (solid his- 
togram) distributions in a) Vertex and b) ^target- 

decay region. The resulting invariant-mass distribution is shown in Fig. 0] (inset). The 
total number of reconstructed H~ — > Att~ — > ptt~tt~ events that would have passed these 
requirements had every event been analyzed was (4.92 ± 0.30) x 10 8 , the error arising from 
the uncertainty in the background subtraction. 

The MC simulation was verified by comparing the simulated H~ — > Air~ events with 
data. Distributions of the reconstructed S~ production point, momentum, decay vertex, and 
daughters' spatial positions downstream of the analyzing magnets, for MC events and data, 
were compared and found to match well (see Fig. EJ). The S~'s were generated at the target 
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TABLE I: Effect of selection requirements 



% surviving in 

Requirement , , , I . , 

ML calculation data 


S momentum 


82.6 


89.9 


^-vertex 


73.6 


58.7 


Single-vertex criteria 


59.1 


8.43 


^target j 2/target 


59.1 


7.29 


K veto 


53.7 


0.67 


S and A vetoes 


34.9 


0.15 


Proton momentum fraction 


31.7 


0.02 



in identical fashion for both the signal and normalizing modes. Since a theoretical calculation 
of the S~ — > pfi~fj,~ decay distribution is not available, it was simulated according to three- 
body phase space. The spectrometer acceptances for the signal and normalizing modes 
(for S~ hyperons emerging from the downstream collimator aperture) were estimated to be 
9.3% and 27.4% respectively, and the respective selection efficiencies (including detection 
and trackfinding efficiencies) were 31.7% and 81.1% 12]. Table H] shows the effect on MC 
and data events (in the mass range 1.315-1.330 GeV/c 2 ) as the selection requirements are 
imposed. 

No signal was observed, and our result is dominated by statistical uncertainty. Nonethe- 
less, we carried out studies of possible systematic effects. The largest systematic uncertainty, 
contributing less than ±6.4%, was due to variations in relative acceptance between the signal 
and normalizing modes due to fluctuations in the position of the beam. The uncertainty due 
to imperfections in the MC simulation of the signal and normalizing modes was estimated by 
varying the parameters in the H~ production model; the resulting rms variation in relative 
acceptance was found to be less than ±3.1%. Variations in muon-detector efficiencies were 
studied using data and the systematic effect on the muon-detection efficiency estimated at 
±1.4%. There is also a ±0.78% contribution to the normalization uncertainty due to our 
imperfect knowledge of B(A — > pn~) = (63.9 ± 0.5)% 9]. (The contribution due to the 
uncertainty of £>(2~ An~) is negligible |9j.) The combined systematic uncertainty in our 
measurement is thus ±7.2%. To derive the 90%-C.L. upper limit on the signal branching 
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ratio, we used a Monte Carlo simulation of a large sample of hypothetical experiments that 
took into account the Poisson fluctuation in the number of signal events observed along 
with the uncertainty of the background estimate and the uncertainty of the normalizing fac- 



13]. 



tor (both treated as Gaussian-distributed) 
events. 

The signal-mode branching fraction is thus 



The resulting upper limit was N si „ < 4.05 



k>/^ — — — \ -^sig ^norm ^norm 

B{z ->• pn (i ) = — -5- x — — x - — 

-'"'norm sig ^sig 

xB(ET ^Air-) xB(A^pn-) (1) 

4.05 0.274 0.811 

< x x x 0.99887 x 0.639 

4.92 x 10 8 0.093 0.317 

< 4.0 x 10~ 8 at 90% confidence. (2) 

Here, N denotes the number of events observed and A and e are the acceptance and efficiency, 
with subscripts sig designating the signal mode S _ — > pyT pT and norm the normalizing 
mode H~ — > Att~ , A — > £>7r~. 

In summary, based on data from the 1997 run of HyperCP, we see no signal for the 
lepton- number- violating decay S~ — > ppTpT . We set an upper limit on the branching ratio 
— > pfi~fi~) < 4.0 x 10 -8 at the 90% confidence level. Our measurement improves upon 
the existing limit by four orders of magnitude. 
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